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The  false  alarm  andf  detection  probabilities  of  an  N-channel  system 
subject  to  L+l  level  quantization,  or-lng,  and  accumulation  of  M  time 
samples,  are  evaluated  exactly,  with  no  Gaussian  assumptions,  for  arbitrary 
values  of  N,  L,  M,  and  for  a  quantizer  with  arbitrary  breakpoint  locations. 
The  channel  noises  are  Independent  but  can  have  arbitrary  statistics.  The 
signal  occupies  one  unknown  (possibly  changing)  channel.  If  present.  Two 
FFTs  suffice  to  sweep  out  a  complete  detection  probability  vs.threshold curve, 

(over) 


The  optimum  placement  of  quantizer  breakpoints,  for  a  fixed  total  number 
of  levels,  L+l,  Is  a  subtle  one  and  Is  shown  to  depend  on  N,  M,  and  the 
desired  level  of  performance;  a  simple  rule-of-thumb  Is  presented  which 
yields  near-optimum  capability  over  the  useful  range  of  the  operating 
characteristics.  A  brief  comparison  with  the  optimum  processor  Is  made. 
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DETECTION  PERFORMANCE  CHARACTERISTICS  FOR  A 
SYSTEM  WITH  QUANTIZERS,  OR-ING,  AND  ACCUMULATOR 

INTRODUCTION 

Practical  realizations  of  desired  systems  often  incorporate  approximations 
to  the  ideal  processor  or  devices,  for  the  sake  of  reduced  expense  and 
equipment  complexity.  In  particular,  quantization  is  frequently  employed, 
since  it  facilitates  data  handling  and  processing  in  terms  of  storage  and 
execution  time.  In  addition,  the  large  number  of  alternatives  for  signal 
presence  and  location  that  must  be  considered  often  dictates  that  data 
reduction  procedures,  sucn  as  or-ing,  be  adopted.  Both  of  these  suboptimum 
approaches,  quantization  and  or-ing,  degrade  system  performance,  and  it  is 
important  to  know  tne  extent  of  the  degradation.  Alternatively,  it  is 
desirable  to  know  how  much  the  received  signal  strength  must  be  increased  in 
order  to  maintain  a  specified  level  of  performance. 

The  effects  of  or-ing  by  itself  were  analyzed  in  ref.  1,  where  the 
required  input  signal-to-nolse  ratio  for  specified  false  alarm  and  detection 
probabilities  was  evaluated  as  a  function  of  tne  number  of  Input  channels  and 
the  observation  time.  In  ref.  2,  the  additional  degradation  caused  by  the 
inclusion  of  quantization  was  derived,  where  the  number  of  levels  and 
breakpoint  locations  of  the  quantizer  were  completely  arbitrary.  Both  of 
these  analyses,  however,  were  limited  to  second-order  moments  of  the  decision 
variable,  and  were  therefore  most  appropriate  to  the  situation  of  large 
observation  time  and  moderate  false  alarm  probabilities.  That  is,  the 
Gaussian  presumption  played  a  prevalent  role  in  the  analysis.  A  cursory  study 
of  good  quantizer  breakpoint  locations  was  also  given  in  ref.  2. 

Numerical  evaluation  of  tne  or-ing  losses,  based  upon  the  derivations  in 
refs.  1  and  2  ,  were  given  In  refs.  3  and  4,  and  a  more  extensive  investiga¬ 
tion  of  quantizer  characteristics  was  conducted  in  ref.  5,  which  corroborated 
the  results  given  In  ref.  2.  But  again,  all  results  were  based  on  a  second- 
order  moment  approach. 
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Here  we  will  derive  exact  results  for  the  false  alarm  and  detection 
probabilities  of  a  system  with  quantization,  or-ing,  and  accumulation-in-time 
for  arbitrary  input  signal  and  noise  statistics.  Surprisingly,  it  turns  out 
that  inclusion  of  the  additional  nonlinearity  (quantization)  actually 
simplifies  tne  analysis,  and  the  judicious  use  of  FFTs  (fast  Fourier 
transforms)  makes  tne  numerical  evaluation  of  the  probabilities  an  efficient 
and  accurate  procedure. 


2 


SYSTEM  DESCRIPTION  AND  ASSUMPTIONS 

The  system  of  Interest  is  depicted  In  figure  i.  There  are  M  Input 
channels*  each  of  which  Is  subject  to  noise  statistically  Independent  of  the 
ether  channel  noises.  A  signal  It  either  present  on  one  (and  only  one) 
unknown  Input  channel  or  It  is  not  present  at  alls  we  wish  to  make  a  decision 
on  presence  versus  absence  with  good  quality.  The  Input  signal  (if  present) 
need  not  be  additive  to  the  input  noise;  all  that  Is  required  Is  knowledge  of 
the  probability  density  function  of  the  Input  channel  random  variable  xn(m) 

(it  sample  time  m)  for  signal  present.  By  setting  the  signal  strength  to 
zero,  we  obtain  the  probability  density  function  for  noise-only,  of  course. 

It  Is  presumed  that  the  signal,  if  present,  remains  so  for  all  M  discrete 
timi  samples  accumul ated  at  tne  or-ing  output..  However,  tne  signal  could 
remain  f  n  one  channel,  or  ft  could  wander  over  any  number  of  channels  in  a 
deterministic  or  random  manner,  from  time  sample  to  time  sample. 

The  probability  density  functions  of  inputs  {xw(m)}  are  arbitrary  except 
that  they  must  be  identical  for  all  the  nolsenjoly  channels.  Extension  to 
noiMdentlcally  distributed  channel  noises  appears  possible  but  has  not  been 
pofSiMUl.  Ho  Gaussian  assumptions  are  made  at  aify  point  of  the  system  of 
figure  1,  for  the  general 'analysts  to  follow.  However,  tne  numerical  example 
that  we  eventually' pursue  is  for  Gaussian  inputs,  although  this  could  easily 
be  rdplaeed  oy  a  different  case  of  Interest;  in  fact,  some  candidate  examples 
are  listed  later  in  an  appendix. 

lHh  channel  input  xft(m)  is  subject  to  memoryless  quantization,  where 
thb  quantizer  output  U{xw(m)}  has  a  total  of  L+l  levels,  and  the  L  quantizer 
abscise  breakpoints  are  arbitrary;  see  figure  2.  A  general  analysis  for  this 
most-general  quantizer  is  possible  and  wit!  be  outlined  later.  Me  confine  our 
attention  here  to  the  less-general  quantizer  depicted  in  figure  3,  where  the 
ordinate  (output)  levels  are  limited  to  the  equi-spaced  values  0,  1,2,  ...»  i 
but  the  abscissa  (input)  breakpoints  are  arbitrary,  except  that 
b|  i  for  1  £  Z  £  i-l,  without  loss  of  generality. 
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xi(m) 


xM(in) 


Greatest  y(m) 


z  JThreshold 
— ^Comparison 


Quantizers  Or-lng  Accumulator  Decision 

Figure  1.  Nonlinear  System 


Figure  2.  General  Quantizer  Characteristic 


Figure  3.  Specific  Quantizer  Characteristic 
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This  limitation  on  the  possible  quantizer  output  levels  is  not  as 
restrictive  as  first  appears.  Reference  to  figure  1  quickly  reveals  that  if 
the  quantizer  output  levels  were  at  equi-spaced  va;ues  hQ  +^ah,  for 
0  ±JL<  L,  the  operating  characteristics,  namely  detection  probability  versus 
false  alarm  probability,  would  be  completely  independent  of  hQ  and 
ah  (>  0).  Tnat  is,  hQ  and  an  affect  the  absolute  scale  of  y(m)  and  z,  but 
they  can  be  absorbed  in  a  modified  threshold  at  the  system  output.  In  fact, 
if  one  wants  to  approximate  a  given  nonlinearity  (such  as  tanh(x),  for  example) 
by  a  quantizer,  L  can  be  selected  large  enough,  hQ  and  ah  chosen  without 

restriction,  and  the  selected  for  a  good  fit.  Then  the  analysis,  as  con¬ 

tained  here  for  the  quantizer  of  figure  3,  applies  directly,  where  hQ  and  ah 
(determined  from  tne  nonlinear  fit)  are  discarded.  hQ  and  ah  are 
temporarily  used  for  the  fitting  procedure,  but  are  not  fundamental  to  the 
system  operating  cnaracteri sties. 


An  example  of  a  fit  to  tanh(x)  is  given  in  figure  4  for  L  =  7,  where  the 


maximum  ordinate  error  has  been  minimized  and  equalized  at  all  the  steps,  and 
both  functions  approach  *1  as  x  tends  to  *  * .  The  best  locations  of  the 


breakpoints  are  at 


for  this  example.  We  also  have  hQ  *  -1 


for  ,  (1) 

ah  -  2/L. 


The  or-ing  device  in  figure  1  is  subject  to  N  inputs  at  each  discrete  time 
sample  m.  It  selects  the  largest  of  these  N  random  variables  at  each  m  and 
emits  it  to  the  accumulator  as  variable  y(m). 

The  accumulator  adds  up  M  input  time  samples  to  yield  the  decision  variaole 

M 

z  «  ^y(m)  .  (2) 

nt>l 

This  output  z  is  compared  with  a  threshold.  If  the  threshold  is  exceeded,  a 
signal  is  declared  present  at  the  Input  to  the  system;  otherwise,  no  signal  is 
declared.  For  present  analysis  purposes,  it  is  presumed  that  the  discrete 
time  samples  (which  can  actually  take  place  on  the  input  channels)  are 
sufficiently  separated  in  time  that  the  M  random  variables  entering  the 
accumulator  are  statistically  Independent. 


When  quantizer  q  In  figure  1  Is  monotonically  nondecreasing,  the  non¬ 
linear  system  in  figure  1  Is  equivalent  (for  all  Inputs)  to  that  shown  in 
figure  5,  where  the  quantization  and  or-lng  operations  have  been  interchanged.* 
The  random  variable  y(m)  in  figure  5  Is  Identical  to  that  in  figure  1.  We  have 
added  another  random  variable,  w(m).  In  figure  5  that  has  no  counterpart  in 
figure  I,  for  purposes  of  analysis.  This  Interchange  of  operations  is  valid 
whether  the  quantizer  of  figures  2  or  3  is  used. 

Extensions  of  the  above  assumptions  to  more  general  situations,  such  as 
statistically  dependent  Inputs  or  dependent  accumulator  samples,  are  discussed 
in  ref.  2.  However,  the  analysis  there  Is  limited  to  second-order  moments, 
not  threshold-crossing  probabilities  as  considered  here. 


*See  refs.  2  and  4  for  two  different  proofs. 
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ANALYSIS  OF  PERFORMANCE 

In  this  section,  we  evaluate  tne  false  alarm  and  detection  probabilities 
of  the  system  in  figure  5.  The  cumulative  distribution  function  of  an 

individual  channel  input,  for  signal  absent,  is  P^,  where 

P^(u)  *  Probability  (x  <  u)signal  absent)  .  (3) 

The  cumulative  distribution  function  of  the  channel  input  with  signal-present 

is  P^.  Both  of  these  cumulative  distribution  functions  are  presumed  known. 

The  superscript  will  denote  either  hypothesis  HQ  (no  signal  present)  or 
hypothesis  Hj  (signal  present  on, that  channel).  Notice  there  is  no 

restriction  on  the  forms  of  P^  or  P^;  thus  arbitrary  input  statistics 

(including  nonadditive  signals)  are  allowed.  However,  the  noise-only  channels 
are  identically  distributed. 

Since  the  or-lng  output  in  figure  5  is 

w(m)  *  max[x^(m),  ....  xN(mj}  for  1  &  m  s  M  ,  (4) 

tne  cumulative  distribution  function  of  w(m)  is,  for  any  time  instant  m. 


since  the  signal  (if  present)  Is  In  only  one  (arbitrary)  input  channel.  In 
fact,  tne  occupied  channel  can  change  from  sample  m  to  m+1,  in  a  random  or 
deterministic  fashion,  and  (5)  Is  still  applicable. 

The  output  y(m)  of  the  quantizer  in  figure  5  is  limited  to  the  L+l  values 
X*  0,  1,  2,  ...,  L;  see  figure  3.  Therefore  the  probability  density  function 
of  random  variable  y(m)  is  impulsive,  as  shown  in  figure  6,  where  the  area  ^ 
of  the  Impulse  at  4  is  given  by 
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(pw0>l)  for  0 

p„(Vi)  -  PM  for  1  ** i  L-1 

1  -  Pw(bL)  for  l.  L 


Here  |i^jL  are  the  L  abscissa  breakpoints  of  the  quantizer,  and  Pw  is  the  cumu¬ 
lative  distribution  function  of  w,  given  by  (5). 


The  output  of  the  accumulator  in  figure  5  is  called  the  decision  variable 
and  is  given  oy  the  sum  of  H  statistically  independent  random  variables 
according  to 

M 

Z  -  2.  y(M)  •  (7) 


Since  y(m)  can  only  take  on  the  values  0,  1,  2,  ....  L,  the  decision  variable 
z  can  only  take  on  the  values  0,  1,  2,  ....  ML.  Thus  the  probability  density 
function  of  z  is  also  impulsive,  as  depicted  in  figure  7;  the  area  of  the 
impulse  at  n  is  denoted  oy  8n. 

He  now  need  to  relate  the  of  figure  7  to  the  foj]  of  figure  6.  To 
accomplish  this,  we  resort  to  the  characteristic  functions  of  y(m)  and  z. 
Using  tne  statistical  independence  of  the  [y(m)}  ,  the  characteristic  function 
of  z  is 

f2(y)  -  expUfzT  -  [exp(  Ify)^  -  |fy  (J)j  ,  (8) 

where  f  is  the  characteristic  function  of  random  variable  y(m).  But  by  use 
of  figures  6  and  7,  we  have 

•o  L 

fy($)  -  Jdu  py(u)  exp(lfu)  -  exp(ifcf)  ,  (9) 

>0 


00  nu 

fz(*)  •  Jdu  pz(u)  exp(i^u)  -  an  exp(iJFn) 


10 
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«.  A  -  *  *•  -  '  *  - 


A  . 


Substitution  of  (9)  and  (10)  in  (8)  yields 

ML  p  L  -»M 

fz(^)  -  Bn  exp(ifn)  .  <»„  exp(i^)  .  (11) 

n-o  y-o 

Now  the  results  of  appendix  A  indicate  that  the  set  of  numbers  &  "fML  can 

1  nj0 

be  recovered  directly  by  an  Nf-point  OFT  (discrete  Fourier  transform)  of  the 
set  of  characteristic  function  samples 


fz(2wn/Nf)  for  0  s  n  s  Nf-1 


provided  that 


Nf  >  ML+1  . 


And  from  (11),  we  have  the  required  characteristic  function  samples  as 

-  l  — M 

fz(2*n/Nf)  -  exp(12irnj/Nf)|  .  (14) 

k-o  J 

The  sum  onjl  here  is  the  conjugate  of  an  Nf-point  DFT  of  the  L+l  real 
nonzero  numbers  augmented  by  zeros.  When  this  DFT  is  raised  to  the  M-th 

power,  it  constitutes  the  required  Nf  samples  of  the  characteristic  function 
f2  that  are  needed  for  the  DFT  that  leads  to  [en] . 

To  summarize,  (5)  yields  the  cumulative  distribution  function  of  w,  and 

(6)  gives  the  impulse  areas  ja^g  •  An  Nf-point  DFT  of  this  sequence 

(augmented  witn  zeros)  is  taken,  then  conjugated  and  raised  to  the  M-th 
power.  Another  Nf-point  OFT  is  then  taken  and  the  results  divided  by  Nf. 

Tne  end  result  is  impulse  areas  [aj.  The  values  returned  (by  the  second  DFT) 
for  •••»  _2  should  all  be  zero,  as  should  all  the  imaginary  parts. 

Although  any  value  for  Nf  that  satisfies  (13)  Is  permissible,  the  smallest 
power  of  2  is  most  reasonable  since  then  we  can  employ  two  FFTs  above;  this 
time-saving  feature  is  employed  here. 


The  probability  that  decision  variable  z  equals  or  exceeds  integer  value  <3 
is,  from  figure  7, 

ML 

Probability  [z  >  j]  *  for  0  $  ML  .  (15) 

n=J 

Tne  above  analysis  for  the  exceedance  probability  in  (15)  is  exact.  When 
signal  is  present,  (15)  is  the  detection  probability,  whereas  when  signal  is 
absent,  (15)  ii  the  false  alarm  probability.  The  fundamental  input  statistics, 

and  P^l  required  in  (5),  are  arbitrary. 
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QUANTIZER  BREAKPOINT  LOCATIONS 

For  a  given  number,  L+l,  of  quantizer  output  levels,  the  selection  of  the 
L  breakpoints  {b^  should  be  done  so  as  to  optimize  the  performance  of  the 
system,  that  is,  maximum  detection  probability  for  a  specified  false  alarm 
probability.  The  equivalence  of  the  two  processors  in  figures  1  and  5  is  the 
guide  to  good  selection  of  the  breakpoints;  namely  fb^  should  lead  to  a 
maximum  difference  in  outputs  y(m)  for  hypothesis  Hj  vs.  Hq.  However,  as 
figure  5  shows,  this  selection  of  [bj]  is  governed  by  the  probability  density 
functions  of  quantizer  input  w,  not  x;  that  is,  the  quantizer  should  take 
account  of  tne  or-ing  nonlinearity  and  the  number  of  input  channels,  N. 

A  problem  arises  here,  however,  in  that  the  probability  density  functions 
of  w  under  Hj  and  Hq  depend  on  tne  particular  value  of  input  signal-to- 
noise  ratio  that  obtains.  Thus,  the  quantizer  design  should  take  the  input 
signal-to-noise  ratio  into  account.  This  situation  is  frequently  encountered 
in  likelihood  ratio  processing,  in  which  the  optimum  processor  often  requires 
knowledge  of  absolute  levels  of  input  signal  and  noise.  Since  this  knowledge 
is  almost  always  lacking,  a  design  that  is  good  for  representative  values  of 
input  signal-to-noise  ratio,  that  is,  which  correspond  to  adequate  levels  of 
performance,  should  be  adopted.  If  the  input  signal-to-noise  ratio  is  larger 
tnan  tnese  representative  values,  improved  performance  will  result;  if 
smaller,  inadequate  performance  is  expected  anyway,  regardless  of  quantizer 
breakpoint  placements. 

To  get  at  tne  quantizer  design,  consider  the  probability  density  functions 
in  figure  8  for  random  variable  w  under  H^  and  Hq.  wq  is  a  point  beyond 
which  tnere  is  a  small  chance  of  w  ever  reaching  under  HQ;  w-^  is  a  point 
below  which  w  nardly  ever  reaches  under  H^.  Generally  wj  <  Wq  for  cases 
of  practical  importance;  otherwise  near-perfect  performance  is  possible  at 
tnis  signal-to-noise  ratio.  Under  HQ,  we  would  like  to  locate  the  first 
breakpoint  b^  greater  than  wQ;  then  the  false  alarm  probability  would  be 
substantially  zero,  regardless  of  the  remaining  (b^| .  On  the  other  hand, 
under  H^,  we  would  like  to  locate  the  last  breakpoint  bL  less  than  w^; 
then  the  detection  probability  would  be  essentially  1. 
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Figure  8.  Probability  Density  Functions  of  w  in  figure  5 
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These  desirable  quantizer  characteristics  under  Hq  and  Hj  are  depicted 
in  figure  9.  It  is  immediately  seen  that  the  desired  features  of  both  cases 
can  be  realized  for  w  <  w^  and  w  >  Wg;  that  is,  choose  q=Q  for  w  <  Wj, 
and  choose  q-L  for  w  >  Wq.  However  there  is  an  inherent  conflict  in  the 
intermediate  region  w^  <  w  <  Wq.  The  only  way  to  strike  a  reasonable 
compromise  is  to  make  q  small  near  w^  and  make  q  large  near  Wg.  That  is, 
locate  the  breakpoints  in  w^,  Wg  ,  as  indicated  in  figure  10.  We  shall 
make  tnem  equally  spaced  on  the  input  w,  that  is,  b^  -  ^  independent  of X ; 
nonuniform  abscissa  spacings,  such  as  in  figure  4,  are  possible  and  could  give 
slightly  better  performance.  However,  sample  computer  runs  have  demonstrated 
that  for  L  >  4,  essentially  optimum  performance  is  attained  via  uniform 
breakpoint  spacing.  Also,  for  the  larger  values  of  input  signal-to- 
noise  ratio,  it  will  be  shown  that  the  optimum  processor  of  the  available 
inputs  takes  precisely  the  form  of  figure  5,  where  the  quantizer  is  replaced 
by  a  linear  gain. 

The  best  quantizer  placements  in  figure  10  obviously  depend  on  the  number, 
N,  of  input  channels  and  the  input  signal-to-noise  ratio,  since  the 
probability  density  functions  of  w  displayed  in  figure  8  depend  on  these 
quantities.  But  there  is  an  additional  less-obvious  dependence  on  M,  the 
number  of  samples  accumulated  at  the  quantizer  output.  For  larger  M,  the 
separation  of  tne  prooability  density  functions  of  z  under  HQ  and  Hj  will 
become  better,  if  the  input  signal-to-noise  ratio  is  held  fixed.  But  often, 
tne  larger  values  of  M  are  employed  so  that  lower  input  signal-to-noise  ratios 
can  be  tolerated  and  yet  realize  adequate  performance  levels;  thus,  the 
probability  density  functions  of  w  in  figure  8  generally  overlap  more  for  the 
larger  values  of  M.  This  means  that  w^  will  be  smaller  and  therefore  the 
breakpoints  should  be  relocated.  Further  discussion  of  quantizer  breakpoints 
is  deferred  until  the  numerical  investigation  is  undertaken. 
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INPUT  STATISTICS 


Up  to  now,  the  statistics  of  inputs  [x^ln  figures  1  and  5  have  been 
arbitrary.  We  now  specialize  to  the  case  of  Gaussian  noises;  some  other 
candidate  statistics  are  given  in  appendix  B.  In  particular,  the  cumulative 
distribution  functions  under  Hq  and  H^  are 


«n>).  . . ip?) . 

respectively,  where  $  is  the  Gaussian  cumulative  distribution  function 


,(0), 

x 


P'y(u) 


A  A 

$(x)  -  f  dt  (2w)_1/2  exp(-t2/2)e  J  dt  $(t)  . 
-*o  -*6 


(16) 


(17) 


The  means  of  xn  are  mQ  and  m^  under  Hq  and  H^,  respectively,  while  the 
standard  deviation  is  the  common  value  a  in  both  cases.  For  later  use, 
we  define  the  deflection  statistic  of  the  inputs  as 


m1-m0 
di  *  a 


(18) 


Reference  to  (5)  and  (6)  indicates  that  we  need  the  quantities 


>for  1  <  X  s  L, 


(19) 


where  we  have  used  (16),  (17),  and  defined  the  normalized  breakpoints  of  the 
quantizer  as 


4H 


Tor  1  s  X  *  L 


(20) 


Then  (5)  and  (19)  yield 
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for  1  *  X  £  L 


(Z 


Tnese  are  tne  quantities  needed  in  (6)  for  the  areas  in  figure  6. 

(If  the  noise  standard  deviations  were  <jg  and  under  Hg  and  Hj, 
instead  of  tne  common  a  in  (16),  the  only  changes  would  be  to  replace  ^  -di 


in  the  second  line  of  (19)  and  (21)  by  —  -di)^  * 


The  results  in  the 


next  section  are  based  upon  this  Gaussian  noise  example. 
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RESULTS 


By  combining  the  general  result  for  the  cumulative  distribution  function 
Of  w  in  (5)  with  the  Gaussian  example  in  (16),  we  obtain 


-l""1  (*)  f  («-d,)  ,  (22) 

where  we  define  normalized  variable 


and  have  used  (18).  The  probability  density  function  of  w  under  is 


p„t“>  -4i  p»(“>  -  f  5 

re  we  used  (17).  This  probability  density  function  is  plotted  in  figure  11 


Figure  11*  Probability  Density  Function  of  w  for  N  *  3 
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for  N»3  and  several  values  of  d..  if  we  select,  for  example,  d^*5,  the 
points  Wj  and  wq  in  figure  8  correspond  approximately  to  v  ■  1.4  and  4.1 
in  figure  11.  The  curve  for  d^»o  is  the  probability  density  function  of  w 
under  HQ. 

The  false  alarm  probability,  as  given  by  (15)  et  seq.,  is  plotted  in 
figure  12  for  an  example  with 

N-3  input  channels, 

M»5  time  samples  accumulated, 

L-7  quantizer  breakpoints, 

a  1.4(. 45)4.1,  normalized  breakpoints.*  (25) 

(Since  L+l»8  here,  this  is  called  a  3-bit  quantizer.)  Since  threshold  J  can 
only  take  on  integer  values,  the  false  alarm  probability  is  only  defined  at 
those  values,  and  Is  so  indicated  by  crosses  in  figure  12.  The  detection 
probability  PD  is  plotted  vs.  the  false  alarm  probability  Pp  ,  in  figure  13, 

by  eliminating  tne  parametric  dependence  of  both  on  J.  Again,  both  PQ  and 
Pp  are  only  defined  at  discrete  points,  as  indicated  by  crosses;  straight 
lines  have  been  drawn  between  these  points  for  ease  of  association  of  values. 
(In  the  curves  to  follow,  tnese  crosses  are  suppressed.)  The  program  for  the 
generation  of  figures  12  and  13  is  given  in  appendix  C. 

The  cnoice  of  Dreakpoints  in  (25)  has  realized  near-optimum  performance 
for  L«7  and  d.«5,  in  the  upper-left  corner  of  the  plot.  The  curves  for  the 
smaller  values  of  input  signal-to-noise  ratio,  that  is  small  d^,  are  more 
crowded  together;  this  reflects  the  usual  small-signal  suppression  that  is 
characteristic  of  nonlinear  processors. 

To  demonstrate  the  effects  of  a  bad  choice  of  quantizer  breakpoints,  the 
previous  example  in  (25)  is  rerun,  with  normalized  breakpoints 

fy}  -  1, 1,1,1, 1,1, 2,  (26) 

Instead  of  the  uniform  spacing.  The  results  In  figure  14  illustrate  much 
poorer  performance  than  figure  13,  in  addition  to  a  very  erratic  appearance. 


*  The  notation  a(b)c  denotes  the  sequence  a,  a+b,  a+2b,  ....  c-b,  c. 
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Figure  13.  Operating  Characteristics  for{v^  *  1.4(. 45)4.1 
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The  curves  for  constant  must  have  a  nonnegative  slope,  and  never  cross, 
but  can  have  a  wide  variety  of  shapes.  A  similar  bad  placement  for  a  2 -bit 
(L«3)  quantizer  is  given  in  figure  15.  This  jagged  behavior  of  the  operating 
characteristic  is  typical  when  the  breakpoints  are  bunched  together  instead  of 
being  uniformly  spaced. 

The  next  example  is  for 

N-3,  M=16,  L=7,  fy)  =  0(1/3)  2  ,  (27) 

and  is  displayed  in  figure  16.  This  can  be  compared  directly  with  the  results 
of  ref.  2,  figure  5.  Both  require  d^i.22  for  PF«10_3,PD-.5,  and  both 
require  about  d^.1.75  f0r  Pp*10”^,  Pq*.5.  Thus  the  simplified  analysis 
in  ref.  2  is  very  reliable  for  large  M,  where  it  is  reasonable  to  expect 
Gaussian  statistics  to  hold. 

In  order  to  see  if  better  performance  is  attainable  by  modifying  the  break¬ 
points,  we  return  to  the  probability  density  function  in  figure  11  (for  N-3) 
and  observe  that  if  we  want  to  optimize  for  dj-3  (i.e.,  top  left  corner  of 
figure  16),  we  should  choose  Wj«0,  W2*4.  However,  the  narrowing  effect 
on  the  decision-variable  probability  density  function,  due  to  the  averaging 
caused  by  large  M,  indicated  (by  trial  and  error)  that  the  best  normalized 
breakpoints  were 

h)  -  .5( .5)3.5  .  (28) 

The  corresponding  operating  characteristic  is  displayed  in  figure  17;  it  is 
slightly  better  than  figure  16.  Thus  the  significant  modification  in 
normalized  breakpoints  from  figure  16  to  figure  17  did  not  yield  significantly 
better  performance,  for  this  example  with  L*7. 

The  next  example  is  run  for  comparison  with  ref.  2,  figure  8.  Namely  we 

have 

N-3,  M-32,  L-7  ,  (29) 

and  three  different  quantizer  breakpoint  sets: 
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Figure  16.  Operating  Characteristics  for  M  ■  16,{vp]  *  0( 1/3)2 
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fi)(l/3)2 
<  0( .5)3 
[o(.  7)4.2 


In  figure  18 
in  figure  19 
In  figure  20 


(30) 


The  results  In  figures  18  through  20  are  In  almost  perfect  agreement  with  the 
simplified  analysis  In  ref.  2.  The  normalized  breakpoints  in  figure  19  are 
best  in  the  intermediate  range  of  detection  probabilities;  figure  18  is  just 
sligntly  better  for  the  high  performance  region  of  d^«2. 2. 


We  now  present  a  series  of  comparisons  where  some  of  the  parameters  are 
held  constant,  while  tne  remainder  are  varied  in  order  to  determine  the  effect 
upon  the  operating  characteristics.  The  first  comparison  is  for  M-5,  N-10, 
and  tne  quantizer  varied  as  follows: 


L-7, 

-  1.4( .45)4.1 

in  figure  21 

L-3, 

-  2(  .75)3.5 

in  figure  22 

L-l, 

*  -2.75 

in  figure  23 

These  correspond  to  3-bit,  2-bit,  and  1-bit  quantizers  respectively,  where  the 
normalized  breakpoints  have  been  chosen  In  each  case  so  as  to  optimize  the 
performance  for  d^.4.  Increasing  L  beyond  7,  and  changing  the  breakpoints, 
failed  to  Improve  the  operating  characteristic  noticeably  above  that  of  figure 
a.  The  Increase  in  the  input  deflection,  d1#  needed  to  maintain  the  same 
performance  at  Pp-1-Pg«  lo"'*'**  is  approximately  4.5/4  for  L-l  vs  L-7. 

If  Inputs  fxn}  are  interpreted  as  voltages,  this  corresponds  approximately 
to  a  1  dB  degradation  for  the  hard  clipper,  L-l. 


The  next  series  Is  for  M-5  and  tne  quantizer  fixed  at  the  3— bit 
characteristic  in  the  first  line  of  (31).  N  is  varied  over  the  values  1,  5, 
10,  20,  40  in  figures  24-28,  respectively.  The  slight  improvement  in 
performance,  that  might  ensue  from  modifying  the  breakpoints  at  each  N,  was 
not  Investigated  In  tnis  comparison.  Tne  effect  of  Increasing  N  is  to  degrade 
the  performance,  since  the  or-lng  must  select  one  of  the  input  channels  for 
accumulation,  and  it  will  not  always  pick  the  signal-bearing  channel.  The 
Increase  In  d^  required  to  maintain  Pp-1-PD* 10”5  Is  approximately 
5.25/4  -  2.35  dB  for  N-40  vs  N-l. 
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Figure  19.  Operating  Characteristics  for  M  ■  32,  fy)  *  0( .5)3 
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Figure  20.  Operating  Characteristics  for  M  ■  32,  *  0( .7)4.2 
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Figure  23.  Operating  Characteristics  for  L  *  1 
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Figure  25.  Operating  Characteristics  for  N  ■  5 
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Figure  28.  Operating  Characteristics  for  N  ■  40 
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The  last  series  investigates  the  effect  of  varying  M.  In  figures  29 
through  33,  M  takes  on  the  values  1,  2,  5,  10,  and  20,  respectively.  The 
effect  of  increasing  M  is  to  realize  better  performance  with  smaller  input 
signal-to-noise  ratios.  The  decrease  in  d^  allowed,  in  order  to  maintain 
Pp.l-Pp# 10*^,  is  approximately  2.4/6. 8  ■  -9  dB  for  M-20  vs  M»l.  When  M 
is  made  large,  the  approximate  analysis  in  ref.  2  can  be  used  with  confidence; 
this  is  fortunate,  since  in  the  case  of  very  large  M,  the  OFT  size,  ^ 

ML+1,  required  here  may  not  be  easily  attainable  on  some  computer  setups. 
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Figure  29.  Operating  Characteristics  for  M  »  1 


999999 


0)0)0) 
0)0)0) 
0)0)0) 
•  O)  O) 
•  O) 
• 


Figure  30.  Operating  Characteristics  for  M  -  2 
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Figure  31.  Operating  Characteristics  f or  M  ■  5 
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Figure  32.  Operating  Characteristics  for  M  -  10 
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DISCUSSION 


Tne  large  number  of  possible  combinations  of  values  of  N,  M,  L,  and 

precludes  an  exhaustive  compilation  of  results.  Instead  we  have  presented 
some  representative  examples  and  give  a  program  in  appendix  C  by  which  the 
user  can  investigate  his  particular  situation  and  alternatives.  This  program 
gives  exact  results  for  any  quantizer,  provided  only  that  ML  is  not  too  large 
and  that  round-off  errors  do  not  get  out  of  hand.  For  extremely  large  M,  a 
Gaussian  approximation  for  the  decision  variable  is  justified  and  the  analysis 
of  ref.  2  is  applicable. 

If  tne  quantizer  is  not  specialized  to  the  equal  ordinate  spacings  of 
figure  3,  but  is  of  the  general  form  depicted  in  figure  2,  the  performance 
analysis  is  more  difficult.  However,  the  characteristic  function  of  the 
decision  variable  is  still  capable  of  a  closed  form  expression;  see  appendix 
D.  Evaluation  of  tne  cumulative  distribution  function  of  the  decision 
variable  is  possible  via  one  FFT,  according  to  the  methods  given  in  refs.  6 
and  7.  No  numerical  investigation  nas  been  undertaken  of  this  case. 

In  appendix  E,  the  form  of  the  optimum  processor  operating  on  N  input 
channels,  of  whicn  only  one  may  contain  a  signal,  is  derived  and  then 
specialized  to  the  Gaussian  input  example  of  (16).  This  optimum  processor,  in 
general,  requires  knowledge  of  the  absolute  levels  of  the  input  signal  and 
noise.  However,  for  d^  >  2,  tne  form  of  the  optimum  processor  approaches 
that  of  figures  1  or  5,  where  the  quantizer  Is  replaced  by  a  linear  device, 
and  tne  absolute  level  knowledge  is  no  longer  required.  Thus  the  performance 
of  the  system  considered  here  should  be  nearly  optimum  for  large  L  and  well- 
placed  Dreakpoints. 

Exact  analysis  of  the  system  of  figures  1  or  5,  with  a  linear  gain  instead 
of  a  quantizer,  is  more  difficult  than  that  given  here.  A  simplified  second- 
moment  analysis  was  presented  in  ref.  1;  an  exact  analysis  Is  possible  and 
will  be  presented  by  the  author  in  a  future  report. 
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A  detailed  comparison  of  the  exact  performance  results  obtainable  via  this 
report,  with  the  second-moment  results  given  in  refs.  1-5,  has  revealed 
excellent  agreement  over  a  wide  range  of  parameter  values.  However,  until  an 
extensive  thorough  investigation  of  the  two  approaches  is  made  for  a  wide 
range  of  values  of  N,  M,  L,  {vft},  Pp,  and  Pq,  it  is  difficult  to  state 
exactly  where  the  earlier  approximate  analyses  can  be  used  with  full 
confidence.  This  time-consuming  investigation  has  not  been  undertaken; 
however,  the  program  in  appendix  C  affords  the  mechanism  whereby  this 
comparison  can  be  conducted.  The  statements  here  regarding  large  M  and 
moderate  Pp  can  only  be  made  quantitative  after  this  study  is  completed. 
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Appendix  A 


INTERRELATIONS  BETWEEN  CHARACTERISTIC  FUNCTIONS  AND 
PROBABILITY  DENSITY  FUNCTIONS  OF  DISCRETE  RANDOM  VARIABLES 


Suppose  random  variable  x  is  limited  to  the  integer  values  0,  1,  ...» 
and  that  the  probability  of  taking  on  value  n  is  ap.  That  is,  the 
probability  density  function  of  x  is 

N 

px(u)  =  ^an  S(u-n) 

n=0 


The  char acteri sic  function  of  x  is  then 

•  V?>  »  Jdu  exp(ifu)  px(u) 

—  •O 

this  function  has  period  2*  in 


N 

an  exp(ijn) 
n=0  . 


> 


N, 


( A— 1 ) 


(A- 2) 


Now  let  integer  M  be  selected  such  that 

M  i  N+l  .  (A— 3) 

Tnen  consider  M  samples  of  characteristic  function  f  at  increment  2w/M; 
that  is,  consider  the  set  of  samples 


fx(m2w/M)  for  0  <  m  <;  M-l  .  (A— 4) 

Now  let  us  take  an  M-point  DFT  of  these  samples,  and  scale  by  1/M;  that  is, 
for  0  i  k  i  M-l  , 
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M-l 

^  ^  exp(-i  2uink/M)fx(m2ir/M) 
m*0 

M-l  si 

exP(_i  2*rak/M)  an  exp( i 2wnm/M) 


m=0 


n=0 


N 


n=0 

N 


M-l 

^  an^  ^  exp(  i  2w(n-k)m/M) 
m=>0 

for  0  <  k  i  N 


r(^)  . 

2  an  U  ■  {  >  •  <A-5) 

n-0  /  0  for  N  <  k  <  M-l 

Here,  in  the  second  line,  we  used  expression  (A -2)  for  the  characteristic 
function,  and  in  the  last  line,  we  used  (A-3). 

Expression  (A— 5)  states  that  the  scaled  M-point  DFT  of  the  set  of 
characteristic  function  samples,  (A-4),  yields  precisely  the  areas 

£ajJN  of  the  impulses  in  probability  density  function  px,  provided  that 

M  2>  N+l.  Tne  values  returned  by  the  DFT  for  ....  aM_^  should  all  be 

zero. 

More  generally,  if  random  variable  x  is  limited  to  the  values 


ho»  h0+Ah»  •••*  ho+N 

the  characteristic  function  takes  the  form 

N 


(A— 6) 


fx(F)  -  exp(ifh0)  ^  an  exp(ijn  ah) 


(A— 7 ) 


n-0 


In  this  case,  the  sample  set  that  must  be  subjected  to  an  M-point  DFT  is  not 
(A-4),  but  rather 


fx(fl8?)  exp(_1  18?  no)  for0^s  M_1  * 

Wnen  scaled  oy  1/M,  this  DFT  yields  areas  £an}  directly. 


(A-8) 
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Appendix  8 


ALTERNATIVE  INPUT  STATISTICS 

Here  we  give  the  equations  for  two  other  typical  random  processes  that 
could  serve  as  candidates  for  Inputs  to  the  nonlinear  system  of  Interest.  No 
numerical  results  have  been  evaluated  for  either  of  the  following. 

CHI-SqUARED  RANDOM  VARIABLES 


This  case  could  correspond  to  Gaussian  noise  with  additive  Gaussian 
signal,  after  passage  through  a  square-law  device  and  summation.  That  Is, 
under  Hi,  consider  tne  signal-bearing  channel  Input  to  be  the  sum 

2D 

x(m)  =»  It  (m)  +  nR 

where  £sk(m)J  and  £nk(m)}  are  Independent  zero-mean  Gaussian  random 

2  2 

variables  with  variances  os  and  on  for  the  signal  and  noise,  respectively, 
x  is  a  Chi-squared  variate  with  20  degrees  of  freedom. 


2  2  2 

Letting  ®i  *  ®s  +  «n  »  the  probability  density  function  of  x  is  given  by 
pli)lu) - 4^  for  u  >  0  .  (B-2) 

(0-1)!  V  &1/  ■ 

The  cumulative  distribution  function  of  x  Is,  via  repeated  integration  by 
parts,  given  by 


P(i)(u)  -  1  -  exp 


for  u  >  0 


where  (ref.  8,  6.5.11) 


(B-3) 


(B— 4) 
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is  tne  first  0  terms  of  exp(t). 


The  cumulative  distribution  function  of  x  under  Hq  follows  immediately 


2  2  2 
from  (B— 3)  by  setting  ■  0  and  identifying  Og  “  °n  : 


P(^(u)  -  1  -  exp 


(-  tii) 


for  u  >  0 


(B-5) 


In  fact,  ( B— 3 )  and  (B-5)  could  be  used  as  input  statistics  for  the  analysis 
contained  here  in  the  main  body  of  the  report,  without  the  need  for 
interpretation  (B-l);  (B-l)  merely  lends  the  physical  interpretation  of  x  as 
the  sum  of  a  number  of  diversity  Inputs. 


According  to  (5)  and  (6),  we  need  the  quantities 


p<«)(^)-1-‘x',(-s)  eo-i M 


P<1)  (*)  *  1  -  e0-l  R  5 


for  1  <  £  L  ,  (B-6) 


where  now  the  normalized  breakpoints  are  defined  as 


for  • 


(B-7) 


Of  course,  we  should  always  select  ^  j  0,  since  x  is  never  negative. 


NONCENTRAL  CHI -SQUARED  RANDOM  VARIABLES 


This  case  corresponds  to  Gaussian  noise  with  additive  deterministic 
signal,  after  passage  through  a  squarer  and  summation.  Under  Hj,  let  the 
Input  be  composed  as  follows: 

2D 

x(m)  -  ♦  nk(m)J  2  ,  (B-8) 


where  jck(m)}  are  constants,  and  noises  {nk(mj}  are  Independent  zero-mean 


Gaussian  random  variables  with  variance  o*.  For  example,  x(m)  corresponds  to 


y  i  ** »  * .  r. 
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the  sum  of  0  squared-envelopes  of  the  output  of  a  narrowband  filter  subjected 
to  a  sinewave  and  Gaussian  noise.  Tne  probability  density  function  of  x  in 
(B-8)  is 


where 


[“20  nl  12 

‘  *  T  2  ck("> 

n  Lk-1  J 


for  u  >  0, 


( B— 9) 


( B— 10) 


is  a  measure  of  the  total  signal-to-noise  ratio  of  random  variable  x(m). 

(a  is  generally  a  function  of  m.)  The  cumulative  distribution  function  is 

P(J}(u)  -  1  -  q/a,^  for  u  >  0  ,  (B-ll) 


(■•f) 


for  u  >  0 


where  the  Q-f unction  is  (ref.  9) 


Q0(a,b)  5  Jdt  t(|)°  1  expf-  — g— j  l0_x  (at)  .  (B-12) 

b  V  7 

Tne  probability  density  function  and  cumulative  distribution  function 
under  rtQ  follow  from  (8-9)  and  (B-ll)  by  setting  a»0,  where  we  presume  that 
{ck(mj} represent  the  signal  components  in  (B-8);  there  results 


for  u  >  0 


(B— 13) 


According  to  (5)  and  (6),  we  need 

p<x’W  *  1  -  exp (-'Jt)  Vi  (i)  1 

'VM  •  »  -  %(>-  J 

where  normalized  breakpoints 

for  1  1.4  i  L  . 

*  2a 

n 

Again  2  0  since  x  in  (B-8)  can  never  be  negative. 


for  u  >  0 


(8-14) 


for  1  L 


( B— 15) 


( B— 16) 


53/54 
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Appendix  C 


PROGRAM  FOR  DETECTION  AND  FALSE  ALARM  PROBABILITIES 

10  !  DETECTION  CHARACTERISTICS  FOR  QUANTIZERS,  GREATEST-OF,  AND  ACCUMULATOR 

20  !  QUANTIZER  OUTPUT  (ORDINATE)  LEVELS  ARE  SET  AT  8,1 . L;  L+l  LEVELS 

30  !  QUANTIZER  ABSCISSA  BREAKPOINTS  ARE  ARBITRARY;  L  BREAKPOINTS 

40  11*5  !  NUMBER  OF  TIME  SAMPLES  ACCUMULATED:  M>*1 

50  N*3  !  NUMBER  OF  INPUT  CHANNELS  SUBJECT  TO  OR-ING:  N>=1 

60  L*7  I  NUMBER  OF  NON-ZERO  QUANTIZER  OUTPUT  LEVELS:  L>*1 

78  !  NORMALIZED  ABSCISSA  BREAKPOINTS  OF  QUANTIZER  <L  NUMBERS): 

SO  DATA  1.4, 1.35, 2. 3,2. 75, 3.2, 3. 65, 4. 1 

SO  Din»%x*4.5  !  MAXIMUM  VALUE  OF  Di  OF  INTEREST 

100  Di step*. 5  !  INCREMENTS  IN  Di  OF  INTEREST 

110  Np*6  !  SMALLEST  PROBABILITY  OF  INTEREST  IS  10M-Np> 

120  DIM  X(l: 1024), Y<1! 1024), AxisCl: 19) 

130  DIM  V(l:l0),S<l:i0),Pw<l:l0),Pfa(l:1024) 

140  redim  v<i:L),s<i:L),Pw<i:L>,Pf*a:M*L> 

150  READ  V<*> 

160  PRINTER  IS  0 

170  PRINT  "NUMBER  OF  TIME  SAMPLES  ACCUMULATED:  M  *“;M 

188  PRINT  "NUMBER  OF  INPUT  CHANNELS  SUBJECT  TO  OR-ING:  N  *M;N 

190  PRINT  "NUMBER  OF  NON-ZERO  QUANTIZER  OUTPUT  LEVELS:  L  =";L 

208  PRINT  "  QUANTIZER  OUTPUT  (ORDINATE)  LEVELS  ARE  SET  AT  0,1,..., L." 

210  PRINT  “  QUANTIZER  NORMALIZED  (ABSCISSA)  BREAKPOINTS  ARE  AT:" 

220  FOR  J-l  TO  L 

230  PRINT  V(J>; 

240  NEXT  J 
250  PRINT 

260  PRINT  "INPUT  VOLTAGE-SNR  Di  VARIES  FROM  0  TO" ; Di max; “IN  STEPS  OF";Distep 
270  PRINT 

280  PRINT  "THE  GRAPH  BELOW  GIVES  THE  (FALSE  ALARM)  PROBABILITY  THAT  THE" 

290  PRINT  "SYSTEM  OUTPUT  IS  GREATER  THAN  OR  EQUAL  TO  J,  FOR  J  «  1  TO  ML." 

300  PRINT  "THE  INPUT  SIGNAL-TO-NOISE  RATIO  IS  ZERO  FOR  THIS  GRAPH." 

310  M0»M*L 

320  Ml*MO+l 

330  M2*Mx2 

340  N1*N-1 

350  FOR  J*2  TO  10 

360  Nf *2AJ 

370  IF  Nf >M0  THEN  420 

380  NEXT  J 

390  PRINT 

400  PRINT  "ARRAYS  X,Y,Pf&  ARE  NOT  DIMENSIONED  LARGE  ENOUGH" 

410  STOP 

420  REDIM  X(l:Nf),Y(l!Nf) 

430  FOR  J«1  TO  L 

440  S( J)*FNPhi (V( J) )"N1 

450  NEXT  J 

460  FOR  Di *0  TO  Di**>:  STEP  Distep 
470  FOR  J*1  TO  L 

480  Pw( J)»S( J)*FNPhi < V( J)-Di )  !  EQUATIONS  5  AND  21 

490  NEXT  J 
500  MAT  X*ZER 
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SI  0 
520 
530 
540 
550 
560 
570 
580 
598 
6O0 
610 
620 
630 
640 
650 
660 
670 
686 
690 
700 
710 
720 
730 
740 
750 
760 
770 
780 
790 
800 
810 
820 
830 
840 
850 
860 
878 
880 
890 
980 
910 
920 
930 
940 
950 
960 
970 
980 
990  ! 
1000 


<X-i Y>-M 


BETR  OF  FIGURE  7 


MAT  Y-ZER 

X<l>-Pw<l>  !  EQUATION  6;  Alph*<I>  ir.  X<J+l> 

FOR  J*2  TO  L 
X< J>*Pw<J>-Pw< J-l > 

NEXT  J 

XCL+1 )*l-Pw<L> 

CALL  Ff*<Nf,X<*>,Y<*>> 

FOR  J»1  TO  Nf  !  <X-i Y>  AM 

T»<X<J>a2*Y<J>a2:aM2 

A»M*FNArg<X<J>, Y< J>> 

X<J>«T*COS<A> 

Y<J>»-T*SIN<A> 

NEXT  J 

CALL  Fft<Nf,X<*>,Y<*>> 

FOR  J*1  TO  Ml 

X<J)-X<J)/Nf  !  BETR  OF  FIGURE  7 

NEXT  J 

IF  Di >0  THEN  1228 
PLOTTER  IS  "GRAPHICS" 

GRAPHICS 
NplaNp+1 
Np2»Hp*2+l 
Axi s(Npl )*0 
FOR  J«1  TO  Np 
T*FNInvphi < . 1AJ> 

Axi s<Npl-J)»T 
Axi s<Npl+J>»-T 
NEXT  J 

SCALE  0,M0,Axi*<l >,Axl*<Np2> 

FOR  J«0  TO  M0  STEP  5 
MOVE  J,Axi*<Np2) 

ORAM  J'AxisCl) 

NEXT  J 

FOR  J»1  TO  Np2 
MOVE  0,Axi»<J> 

ORAM  M0, Axi s< J> 

NEXT  J 

PENUP 

T«0 

FOR  J-Ml  TO  2  STEP  -1 
T»T+X<J> 

I»J-1 

IF  <T> IE-1 1 >  AND  <T< 1-lE-l 1 >  THEN  960 

Pf*<I>«100 

GOTO  1050 

A»FNIm*phl  <T) 

Pf4<I>-A 
PLOT  I, A 

GOTO  1050  !  TO  ELIMINATE  CROSSES,  INSERT  THIS  INSTRUCTION 

MOVE  I , A-Ax 1  * ( Np2  >  * . 008 


Cj, 


■  .V.N 


1010 

1020 

1030 

1040 

1050 

1060 

1070 

1080 

1090 

1100 

1110 

1120 

1130 

1140 

1150 

1160 

1170 

1180 

1190 

1200 

1210 

1220 

1230 

1240 

1250 

1260 

1270 

1280 

1290 

1300 

1310 

1320 

1330 

1340 

1350 

1360 

1370 

1380 

1398 

1400 

1410 

1420 

1430 

1440 

1450 

1460 

1470 

1480 

1490 

1500 
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DRAM  I , A+Ax 1 s  <  Np£ ) * . 008 
HOVE  1-.004*H0,A 
ORAM  I+. 004*M0, A 
PLOT  I, A 
NEXT  J 
PENUP 

DUHP  GRAPHICS 
PRINT  LIN<  1 ) 

PRINT  "THE  GRAPH  BELOW  IS  A  PLOT  OF  DETECTION  PROBABILITY  VERSUS" 
PRINT  "FALSE  ALARN  PROBABILITY,  FOR  THE  VALUES  OF  Di  GIVEN  ABOVE." 
GCLEAR 

SCALE  Axi s< 1 > , Axi s<Np2> , Axi *< 1 > , Axi s<hp2> 

FOR  J»1  TO  Np2 
HOVE  Axi  s<  1) ,  Axi  j.<  J) 

DRAW  Ax  i  s  <  Np2  > ,  A>:  i  s  <  J  > 

NEXT  J 

FOR  J*1  TO  Np2 

HOVE  Ax  i »  <  J  )  ,  Ax  i  i.  <  Np2  > 

DRAW  Axi  s<  J) ,  Ax  i  *■<  1 ) 

NEXT  J 

PENUP 

T-0 

FOR  J-MJ  TO  2  STEP  -1 
T«T+X< J) 

IF  <T< IE— 1 1 >  OR  cT>l-lE*ll>  THEN  1360 
B*Pf *<J-1 ) 

IF  ABS<B>>?  THEN  1360 
A-FNInwphi<T) 

PLOT  B.A 

!  GOTO  1360  !  TO  ELIHINATE  CROSSES,  INSERT  THIS  INSTRUCTION 

HOVE  B ,  A-Ax  i  s  <  NpS: )  * .  008 
DRAW  B,A+Ax1s<Np£)*.008 
HOVE  B- Ax  i  &  <  Np2  )  .  008 ,  A 
DRAW  B+Ax i s  <  Np2 ) * , 008 , A 
PLOT  B, A 
NEXT  J 
PENUP 
NEXT  Di 
DUHP  GRAPHICS 
PRINT  LIN<6> 

PRINTER  IS  16 

END 

i 

DEF  FNArg<X,Y>  !  PRINCIPAL  ARGUMENT  OF  X+iY 

IF  X-0  THEN  A«.5*PI»SGN<Y> 

IF  XO0  THEN  A-ATN<Y/X> 

IF  X<0  THEN  A"A+PI*< t-2*<Y<0> > 

RETURN  A 
FNEND 
! 
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1510 

1520 

1530 

1540 

1550 

1560 

1570 

1580 

1590 

1600 

1610 

1620 

1630 

1640 

1650 

1660 

1670 

1680 

1690 

1700 

1710 

1720 

1730 

1740 

1750 

1760 

1770 

1780 

1790 

1800 

1810 

1820 

1830 

1840 

1850 

I860 

1870 

1880 

1890 

1900 

1910 

1920 

1930 

1940 


DEF  FNPhiOO  »  CUMULATIVE  GAUSSIAN  DISTRIBUTION 

IF  ABSOO  >5.  14  THEN  1780 
A*. 2823427 1 2475*X 
C»CO$<A> 

S*SIN< A) 

B»2*C 

A«B*C-1 

C»A*< 1 . 253675  IE- 1 8*B*7. 10805E-20+A*?. 4517E-21 > 

C»A*< 1 . 533423425E>  16+8*1 . 01 649277E- 17+0 
C»A*< 1 . 36760444757E- 1 4+B# 1 • 0601364636E-15+O 
CaA*<8. 89786526722E-13+B*8. 06068838945E-14+C) 

C"A#<4. 226161443 J  8E-1 1+B*4. 46968229249E-12+C > 

C»A*< 1 . 466606 1 4234E-9+B* 1 . 808485878 10E- 1 0+0 
C-A*<3. 72252349369E-8*8*5. 34275027603E-9+O 
C«A*<6.91927520325E-7+B*l. 15330990944E-7+C) 

C»A*<9. 43281 169838E-6+B*1.82066316364E-6*C> 

C»A*<9. 4490926881 0E-5+B*2. 10404583073E-5+C > 

C«A*<6. 97183792408E-4*S#1. 7822801 6255E-4*C> 

C*A#<3. 801507679S5E-3+B*l . 10860645342E-3+C) 

C»A*<. 01539857261 57+B*.  00507986961220+0 
C*A*< . 0467755234325+B+. 8172439625887+0 
C“A»< . 108630245023+B*. 0439773381941+C) 

C»A*  < . 281 339747265+B* . 0869894549959+C  > 

C*A*< . 33050152191 7+B*. 144227226362*0 
C«. 703225002744+B*. 247255168148+C 
Phi «. 5+. 04501581S8079+X+. 5*S*C 
GOTO  1920 
IF  X>7  THEN  1910 

N-MAX<6,  INT<69/AHS<X)>,  INT<525^X-'2)  >♦! 

A-l 

S-l 

B-1/-X 

C«B*B 

FOR  J«1  TO  N 
A«< 1-2*J>*A*C 
S-S+A 
NEXT  J 

Pht«. 398942280401 *EXP<-.5*X#X>*A8S<B>*S 
IF  X>0  THEN  Phi •! -Phi 
GOTO  1920 
Phi»l 

RETURN  Phi 
FNENO 

! 
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1950  DEF  FNInvphi  <Z>  !  INVERSE  CUMULATIVE  GAUSSIAN  DISTRIBUTION 

1960  X»2*Z-1 

1970  DIM  T(0:20),fi<0:20> 

1980  DATA  .992885376619, . 120467516143, . 0169781993421 , . 00268670443716 
1990  DATA  .4996347302<E-3, . 988982186E-4, . 2039181276E-4, . 432727162E-5 
2000  DATA  .93808141E-6, .20673472E-6, .461597E-7, . 1641663E-7, . 23715E-8 
2010  DATA  . 54393E-9, . 1 2555E-9, . 2914E-10, . 679E-1 1 , . 159E-1 1 , . 37E-12 
2020  DATA  .912158803418, -.0162662813677, . 43355647295E-3, . 21443857007E-3 
2030  DATA  . 262575 1 08E -5, -. 3021091 05E-5,-. 1243686E-7, . 6248661E-7, -. 54012E-9 
2040  DATA  -. 142321E-8, . 3438E-10, . 3358E-10, -. 146E-1 1 , 81E-12, . 5E-13, . 2E-13 
2050  DATA  . 956679709020, -. 0231070043091 , -. 08437423609751 57650342265E-3 
2060  DATA  -. 1096102231 E-4, .2510S54702E-4, . 1056233607E-4, . 275441233E-5 
2070  DATA  . 43248450E-6, -. 2053034E-7, -. 4389154E-7, -. 1768401E-7, -. 399129E-8 
2080  DATA  -. 18693E-9, .27292E-9, . 13282E-9, .3183E-10, . 167E-1 1 , 204E-1 1 
2090  DATA  -. 965E-12, -. 22E-12 
2100  B*ABS<X) 

2110  IF  ABS<X>  >*. 8  THEN  8»SQR<-LOG< < 1-X>*<1+X> )  > 

2120  IF  ABS<X)< . 8  THEN  2220 
2130  IF  ABS<X>< . 9975  THEN  2180 
2140  Nmax»20 
2150  RESTORE  2050 

2160  Y»-. 559457631330+B+2. 28791571626 

2170  GOTO  2250 
2130  Nm*x*15 

2190  RESTORE  2020 

2200  Y— 1.54881304237+8+2. 56549012315 

2210  GOTO  2250 

2220  N»*x-18 

2230  RESTORE  1980 

2240  Y-X+X+3. 125-1 

2250  REDIM  A<0:Nmax> 

2260  READ  A<*> 

2270  Y2-Y+2 

2280  T<0>-1 

2290  T< l >»Y 

2300  FOR  N>2  TO  Nm*x 

2310  T<N)«Y2*T<N-1 >-T<  N-2) 

2320  NEXT  N 
2330  Rs0 

2340  FOR  N»Ni»*x  TO  8  STEP  -1 
2350  R«R+A<N>*T<N> 

2360  NEXT  N 

2370  Irwphi»$GN<X>*B*R*l. 41 421 356237 
2380  RETURN  Invphl 
2390  FNEND 
2480  ! 

2410  SUB  Fft<N,X<*>, Y<*>>  !  FFT  SUBROUTINE  HERE 
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Appendix  0 


ANALYSIS  FOR  GENERAL  QUANTIZER 


The  characteristic  function  of  decision  variable  z  Is  still  given  by  (8) 
in  terms  of  f  tne  cnaracteristic  function  of  y.  But  now,  from  figures  5 
and  2, 


fy(F)  *  exp(iJPy)  >  exp(iFqfwJ)  »  J  du  pw(u)  exp(ifqfu)) 

-  exp(ifh0)  Jdu  pw(u)  +  ...  +  exp(ifhL)  T  du  pw(u) 

—00  J 

bL 


L-l 

-  exp(1Th0)  P^bj)  +  ]>  expdty)  [P^b,^)  -  Pw(b4)] 

i- 1 

+  exp(1JhL)  [l  -  w(bL)]  ,  (D-l) 

wnere  P  ^  is  the  cumulative  distribution  function  of  random  variable  w,  as 
given  by  (5).  The  Inputs  for  tnis  calculation  of  characteristic  function  f^ 

are  rt,  N,  L,  f^}L  and  •  Again,  input  cumulative  distribution  functions 
P^  and  P^  in  (5)  are  arbitrary. 

One  problem  with  this  quantizer  Is  that  Pq  and  Pp  are  stepwise  functions 
of  the  decision  threshold  (which  need  not  be  Integer  now)  at  irregular  points. 

A  large  OFT  size  would  be  necessary  to  track  this  behavior.  However,  operating 
characteristic  plots  of  Pq  vs.  Pp  would  be  smoother  functions. 
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Appendix  E 


DERIVATION  OF  OPTIMUM  PROCESSOR 


We  allow  tne  signal.  If  present,  to  jump  randomly  and  Independently 
between  Input  channels  on  each  time  sample.  Let 

Y(m)  *  7xn(m)}  for  l<mjM 

l  n  J  n-1 

Under  H^,  tne  probability  density  function  of  N-vector  Y(m)  is 

P^(Y(m))  *  i  p^(x2(m))  ...  p^°^(xN(m)) 

+  p(0)(x1(m))  p(1)(x2(m))  ...  p(0)(xN(m))  ♦  ...} 


n-1  '  n-1 


pl(xn(fl)) 


for  1  i  m  i  M 


Tnerefore  the  joint  probability  density  function  is 


p<i,<y(i)  ••• ¥(,,),  ■  i  i[  fp<o,{x"(m,)}  j 


r  »(1)Kw) 

_(0)> 


.  (E- 


Tne  likelinood  ratio  follows  Immediately  as  the  last  product  in  (E-3);  the 
log-likelihood  ratio  is  therefore 


M  /  N  p(l)/x 


Tnls  result  holds  for  arbitrary  Inputs  with  probability  density  functions 
p(0)  and  pU). 

When  we  employ  tne  Gaussian  example  in  (16),  (E-4)  simplifies  to 


-i>7» 


< 

> 


threshold 


9 


(E-: 


where  data-inde££fxt€nt  scale  factors  have  been  absorbed  In  the  threshold. 
Exact  analysis  of  (E-5)  is  conceivable,  but  is  exceedingly  tedious.  Also 
and  a  must  be  known  in  order  to  realize  (E-5). 


For  di  >2,  it  may  be  shown,  to  a  good  approximation,  that 


Substitution  in  (E-5)  yields  the  approximate  likelihood  ratio  test 
M 

{x^mji}  <  thre*hold  •  (E-7 

nul  n 

Knowledge  of  and  a  is  now  not  required.  Processor  (E-7)  is  just  figure 
1  or  5,  with  the  quantizer  replaced  by  a  linear  gain.  This  special  case  of 
(E-5)  is  very  important,  because  decent  performance  can  be  obtained  for 

di  >  2,  and  this  Is  exactly  where  (E-7)  is  virtually  optimum.  A  good 
approximation  to  the  performance  of  (E-7)  Is  afforded  by  the  results  contained 
herein.  If  L  Is  chosen  large  and  the  breakpoints  are  well-placed.  Some 
approximate  results  via  second-moment  approaches  are  given  in  refs.  1,  10,  11, 
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